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(57) Abstract: A system for estimating the recipe of a dish under cooking with high accuracy by specifying the foodstuff and the 
cooking operation for the foodstuff with high accuracy. The syston for recognizing cooking operation of foodstuff comprises; a 
sensing section (200) provided with an optical camera (10) for photographing the cooking situation of a cook, a thermal camera (20X 
and a microphone (30) for acquiring oivironmental sound; a section (106) for making a feature amount template &om a foodstuff 
database, a cooking material database (104), and a cooking operation database (105), and a recognition processing section (110) for 
7^ calculating the degree of observation confidence of the foodstuff being cooked and cooking operation of a cook based on observation 
0^ data acquired at the sensing section (200), making a cooking flow based on the degree of observation confidence, calculating the 
QQ adaptability of the cooking flow thus made based on the degree of confidence of template written on the feature amount template;. 
O and recognizing the foodstuff, cooking operation and cooking recipe. 
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